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AMENDMENTS TO THE CLAIMS 

This listing of claims replaces all prior versions, and listings, of claims in the application: 
Listing of Claims; 

1. (Original) A method for detecting a patterned object placed adjacent to an 
interactive display surface, the interactive display surface having a surface origin, and a plurality 
of surface coordinate locations defined along two orthogonal axes in relation to the surface 
origin, comprising the steps of: 

(a) detecting a physical property of the patterned object when the patterned object is 
placed in any arbitrary orientation adjacent to an object side of an interactive display surface; 

(b) creating a template of the patterned object at a known orientation, the template 
comprising a quadrilateral template bounding region having a side aligned with one of the two 
orthogonal axes and a set of template data values associated with the quadrilateral template 
bounding region, each template data value representing a magnitude of the physical property at a 
different one of a plurality of surface coordinate locations within a bounding area encompassing 
the patterned object; 

(c) computing a sum of the set of template data values; 

(d) acquiring input data values from the interactive display surface, each of the input data 
values corresponding to a different one of the plurality of surface coordinate locations of the 
interactive display surface, each input data value representing a magnitude of the physical 
property detected at a different one of said plurality of surface coordinate locations; 

(e) calculating a difference score between the template data values and the input data 
values encompassed by the quadrilateral template bounding region; and 

(f) if the difference score is within a match threshold, determining that the patterned 
object is on or adjacent to the interactive display surface. 



Page 2 of 20 



Application No. 10/813,855 

Amendment "C" dated June 19, 2009 

Reply to Final Office Action mailed February 19, 2009 

2. (Original) The method of Claim 1 , further comprising the step of determining 
whether an integral sum of the input data values encompassed by the quadrilateral template 

bounding region is within a first threshold of the sum of the set of template data values, and if 
so, proceeding with the step of calculating the difference score. 

3. (Original) The method of Claim 1, wherein: 

(a) the physical property that is detected comprises light intensity; 

(b) the template data values comprise pixel values, each pixel value indicating an 
intensity of light reflected from the patterned object while the patterned object is adjacent to the 
interactive display surface in a template acquisition mode; and 

(c) the input data values comprise pixel values indicating an intensity of light 
reflected from the patterned object while the patterned object is adjacent to the interactive 
display surface in a run-time mode. 

4. (Original) The method of Claim 2, fiirther comprising the steps of: 

(a) creating a plurality of rotated templates, wherein each one of the plurality of 
rotated templates comprises a set of fransformed template data values determined at a different 
rotation angle relative to the orthogonal axes; 

(b) for each of the plurality of rotated templates, creating a binary mask comprising: 

(i) an active region having a shape and encompassing the set of transformed 
template data values, wherein an orientation of the active region matches an orientation 
of the rotated template relative to the orthogonal axes; and 

(ii) a mask bounding region that is used for the quadrilateral template 
bounding region, the mask bounding region having a quadrilateral shape with a side 
aligned with one of the orthogonal axes and surroimding the active region, wherein an 
orientation of the mask bounding region remains fixed relative to the interactive display 
surface, and wherein dimensions of the mask bounding region are minimized to just 
encompass the active region; 

(c) performing the step of Claim 2 using the mask bounding region as the 
quadrilateral template bounding region so that a different rotated mask integral sum is computed 
for the input data values encompassed by each mask bounding region corresponding to each of 
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the plurality of rotated templates, and so that the rotated mask integral sum is evaluated relative 
to the first threshold; and 

(d) determining for which of the plurality of rotated templates the rotated mask 
integral simi of the rotated template most closely matches the sum of the set of template data 
values encompassed by the corresponding mask bounding region. 

5. (Previously Presented) The method of Claim 4, wherein step (d) 
comprises the steps of: 

(a) creating a hst of rotated templates that are within the first threshold; and 

(b) for each rotated template in the list, determining a distance between a first center 
associated with the mask bounding region corresponding to the rotated template and a second 
center associated with the mask bounding region used as the quadrilateral template bounding 
region; 

(c) determining whether the distance is less than a redundancy threshold; and 

(d) if the distance is less than the redundancy threshold, replacing the rotated 
template in the hst with the rotated template corresponding to the mask bounding region used as 
the quadrilateral template bounding region. 

6. (Original) The method of Claim 2, wherein the step of determining the integral sum 
comprises the steps of: 

(a) computing an integral image array fi-om the input data values, the mtegral image 
array comprising a plurality of array elements, each array element corresponding to one of the 
plurality of surface coordinate locations of the interactive display surface, and each array element 
comprising a sum of all input data values encompassed by a quadrilateral area fi-om the surface 
origin to a corresponding surface coordinate location; 

(b) selecting four array elements corresponding to four comers of the quadrilateral 
template boimding region, for association with a selected surface coordinate location and to aUgn 
with the orthogonal axes; and 

(c) computing the integral sum as a fimction of the four array elements, each of 
which represents an area encompassing input data values of the interactive display surface, 
thereby determming the sum of input data values encompassed by the quadrilateral template 
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bounding region as a function of sums of quadrilateral areas between the surface origin and the 
quadrilateral template bounding region. 

7. (Original) The method of Claim 6, further comprising the step of associating the 
quadrilateral template bounding region with a succession of surface coordinate locations to 
determine an integral sum most closely matching the sum of the set of template data values, to 
detect a region of the interactive display surface to which the pattemed object is adjacent. 

8. (Original) The method of Claim 7, wherein a plurality of integral sums are 
determined for a plurality of mask bounding regions corresponding to a plurality of rotated 
templates at each of the succession of surface coordinate locations. 

9. (Original) The method of Claim 1, wherein the difference score is calculated as one 
of a sum of absolute differences and a sum of squared differences. 

10. (Original) The method of Claim 1, further comprising the steps of: 

(a) computing a statistical moment of the set of template data values; 

(b) computing a statistical moment of the input data values; and 

(c) determining whether the statistical moment of the input data values is within a 
moment threshold percentage of the statistical moment of the set of template data values. 
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1 1 . (Currently Amended) A computer-readable memory medium on which are stored 
machine instruction s which, when executed upon one or more computer processors, for carrying 
ett tperform each of the steps of Claim 1. 



Page 6 of 20 



Application No. 10/813,855 

Amendment "C" dated June 19, 2009 

Reply to Final Office Action mailed February 19, 2009 

1 2. (Original) A system for detecting a patterned object, comprising: 

(a) an interactive display surface having a surface origin, a plurality of surface 
coordinate locations defined along two orthogonal axes in relation to the surface origin, an 
interactive side adjacent to which the patterned object can be placed and manipulated, and an 
opposite side; 

(b) a light source that directs infrared light toward the opposite side of the interactive 
display surface and through the interactive display surface, to the interactive side; 

(c) a light sensor disposed to receive and sense infrared light reflected back from the 
patterned object through the interactive display surface; 

(d) a processor in communication with the light sensor; and 

(e) a memory in communication with the processor, the memory storing data and 
machine instructions that cause the processor to carry out a plurality of fimctions, including: 

(i) detecting an intensity of the infrared light reflected back &om the 
patterned object with the Ught sensor; 

(ii) creating a template of the patterned object at a known orientation, the 
template comprising a quadrilateral template bounding region having a side aligned with one of 
the two orthogonal axes and a set of template data values associated with the quadrilateral 
template bounding region, each template data value representing an intensity of reflected 
infrared light at a different location within a bounding area encompassing the patterned object; 

(iii) computing a sum of the set of template data values; 

(iv) acquiring input data values from the interactive display surface with the 
light sensor, each of the input data values corresponding to the intensity of infrared light 
reflected from a different one of the plurality of surface coordinate locations of the interactive 
display surface; 

(v) calculating a difference score between the template data values and the 
input data values encompassed by the quadrilateral template bounding region; and; 

(vi) if the difference score is within a match threshold, determining that the 
patterned object is adjacent to the interactive surface. 
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13. (Original) The system of Claim 12, wherein the machine instructions further 
cause the processor to determine whether an integral sum of the input data values encompassed 
by the quadrilateral template bounding region is within a first threshold of the sum of the set of 
template data values, and if so continuing with calculating the difference score. 

14. (Original) The system of Claim 12, wherein: 

(a) the template data values comprise pixel values, each pixel value indicating an 
intensity of infrared light reflected from the patterned object while the patterned object is 
adjacent to the interactive display surface in a template acquisition mode; and 

(b) the input data values comprise pixel values indicating an intensity of light 
reflected from the patterned object while the patterned object is adjacent to the interactive 
display surface in a run-time mode. 

15. (Original) The system of Claim 14, wherein the machine instructions ftirther cause 
the processor to: 

(a) create a plurality of rotated templates, wherein each one of the plurality of rotated 
templates comprises a set of transformed template data values determined at a different rotation 
angle relative to the orthogonal axes; 

(b) for each of the plurality of rotated templates, create a binary mask comprising: 

(i) an active region having a shape and encompassing the set of 
transformed template data values, wherein an orientation of the active region matches an 
orientation of the rotated template relative to the orthogonal axes; and 

(ii) a mask bounding region that is used for the quadrilateral template 
bounding region, the mask bounding region having a quadrilateral shape with a side aligned with 
one of the orthogonal axes and surrounding the active region, wherein an orientation of the mask 
bounding region remains fixed relative to the interactive display surface, and wherein 
dimensions of the mask bounding region are minimized to just encompass the active region; 

(c) determine whether an integral sum of the input data values encompassed by the 
quadrilateral template bounding region is within a first threshold of the sum of the set of template 
data values by using the mask boxmding region as the quadrilateral template bounding region so 
that a different rotated mask integral sirai is computed for the input data values encompassed by 
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each mask bounding region corresponding to each of the plurahty of rotated templates, and so 
that the rotated mask integral sum is evaluated relative to the first threshold; and 

(d) determine for which of the plurality of rotated templates the rotated mask integral 
sum of the rotated template most closely matches the sum of the set of template data values 
encompassed by the corresponding mask bounding region. 

16. (Original) The system of Claim 15, wherein the machine instructions further cause 
the processor to: ' 

(a) create a list of rotated templates that are within the first threshold; and 

(b) for each rotated template in the list, determine a distance between a first center 
associated with the mask boimding region corresponding to the rotated template and a second 
center associated with the mask bounding region used as the quadrilateral template bounding 
region; 

(c) determine whether the distance is less than a redundancy threshold; and 

(d) if the distance is less than the redundancy threshold, replace the rotated template in 
the hst with the rotated template corresponding to the mask boimding region used as the 
quadrilateral template bounding region. 

17. (Original) The system of Claim 13, wherein to determine the integral sum, the 
machine language instructions fiulher cause the processor to: 

(a) compute an integral image array firom the input data values, the integral image 
array comprising a plurality of array elements, each array element corresponding to one of the 
plurality of surface coordinate locations of the interactive display surface, and each array element 
comprising a sum of all input data values encompassed by a quadrilateral area from the surface 
origin to a corresponding surface coordinate location; 

(b) select four array elements corresponding to four comers of the quadrilateral 
template bounding region, for association with a selected surface coordinate location and to align 
with the orthogonal axes; and, 

(c) compute the integral sum as a function of the four array elements, each of which 
represents an area encompassing input data values of the interactive display surface, thereby 
determining the sum of input data values encompassed by the quadrilateral template boimding 



Page 9 of 20 



Application No. 10/813,855 

Amendment "C" dated June 19, 2009 

Reply to Final Office Action mailed February 19, 2009 



region as a fimction of sums of quadrilateral areas between the surface origin and the 
quadrilateral template bounding region. 

18. (Original) The system of Claim 17, machine language instructions further cause the 
processor to associate the quadrilateral template bounding region with a succession of surface 
coordinate locations to determine an integral sum most closely matching the sum of the set of 
template data values, to detect a region of the interactive display surface to which the patterned 
object is adjacent. 

19. (Original) The system of Claim 18, wherein a plurality of integral sums are 
determined for a plurality of mask bounding regions corresponding to a plurality of rotated 
templates at each of the succession of surface coordinate locations. 

20. (Original) The system of Claim 12, wherein the difference score is calculated as one 
of a sum of absolute differences and a sum of squared differences. 

21. (Original) The system of Claim 12, machine language instructions further cause the 
processor to: 

(a) compute a statistical moment of the set of template data values; 

(b) compute a statistical moment of the input data values; and 

(c) determine whether the statistical moment of the input data values is within a moment 
threshold percentage of the statistical moment of the set of template data values. 

22-26. (Cancelled) 
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27. (New) A method for detecting a patterned object placed adjacent to an interactive 
display surface, the interactive display surface having a surface origin, and a plurality of surface 
coordinate locations defined along two orthogonal axes in relation to the surface origin, the 
method comprising: 

detecting a physical property of a patterned object when the patterned object is placed in 
an arbitrary orientation adjacent to an object side of an interactive display surface; 

determining a rectangular area large enough to surround the patterned object; 

displaying on the interactive display table a rectangular bounding box the size of the 
rectangular area, positioned around the object, and aligned to the axes of the interactive display 
table; 

accepting user input to adjust the dimensions of the rectangular boimding box; 

accepting user input indicating that adjusting the dimensions of the rectangular bounding 
box has been completed; 

creating a template of the patterned object at a known orientation, the template 
comprising a quadrilateral template bounding region having a side aligned with one of the two 
orthogonal axes and a set of template data values associated with the quadrilateral template 
bounding region, each template data value representing a magnitude of the physical property at a 
different one of a plurality of surface coordinate locations within a bounding area encompassing 
the patterned object; 

computing a sum of the set of template data values; 

acquiring input data values from the interactive display surface, each of the input data 
values corresponding to a different one of the plurality of surface coordinate locations of the 
interactive display surface, each input data value representing a magnitude of the physical 
property detected at a different one of said plurality of surface coordinate locations; 

calculating a difference score between the template data values and the input data values 
encompassed by the quadrilateral template boimding region; and 

when the difference score is within a match threshold, determining that the patterned 
object is on or adjacent to the interactive display surface. 
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